Tuning of the k-NN algorithm for compositional data with and without using the power or the \(\alpha\)-transformation. In addition, estimation of the rate of correct classification via M-fold cross-validation.
compknn.tune(x, ina, M = 10, A = 5, type= "S", mesos = TRUE,
a = seq(-1, 1, by = 0.1), apostasi = "ESOV", mat = NULL, graph = FALSE)alfaknn.tune(x, ina, M = 10, A = 5, type = "S", mesos = TRUE,
a = seq(-1, 1, by = 0.1), apostasi = "euclidean", mat = NULL, graph = FALSE)
A matrix with the available compositional data. Zeros are allowed, but you must be careful to choose strictly positive values of \(\alpha\) or not to set apostasi= "Ait".
A group indicator variable for the available data.
The number of folds to be used. This is taken into consideration only if the matrix "mat" is not supplied.
The maximum number of nearest neighbours to consider. Note that the 1 nearest neighbour is not used.
This can be either "S" for the standard k-NN or "NS" for the non standard (see details).
This is used in the non standard algorithm. If TRUE, the arithmetic mean of the distances is calculated, otherwise the harmonic mean is used (see details).
A grid of values of \(\alpha\) to be used only if the distance chosen allows for it.
The type of distance to use. For the compk.knn this can be one of the following: "ESOV", "taxicab", "Ait", "Hellinger", "angular" or "CS". See the references for them. For the alfa.knn this can be either "euclidean" or "manhattan".
You can specify your own folds by giving a mat, where each column is a fold. Each column contains indices of the observations. You can also leave it NULL and it will create folds.
If set to TRUE a graph with the results will appear.
A list including:
A matrix or a vector (depending on the distance chosen) with the averaged over all folds rates of correct classification for all hyper-parameters (\(\alpha\) and k).
The estimated rate of correct classification.
The best value of \(\alpha\). This is returned for "ESOV" and "taxicab" only.
The best number of nearest neighbours.
The run time of the cross-validation procedure.
The k-NN algorithm is applied for the compositional data. There are many metrics and possibilities to choose from. The standard algorithm finds the k nearest observations to a new observation and allocates it to the class which appears most times in the neighbours. The non standard algorithm is slower but perhaps more accurate. For every group is finds the k nearest neighbours to the new observation. It then computes the arithmetic or the harmonic mean of the distances. The new point is allocated to the class with the minimum distance.
Tsagris, Michail (2014). The k-NN algorithm for compositional data: a revised approach with and without zero values present. Journal of Data Science, 12(3): 519-534. https://arxiv.org/pdf/1506.05216.pdf
Friedman Jerome, Trevor Hastie and Robert Tibshirani (2009). The elements of statistical learning, 2nd edition. Springer, Berlin
Tsagris Michail, Simon Preston and Andrew T.A. Wood (2016). Improved classification for compositional data using the \(\alpha\)-transformation. Journal of classification 33(2): 243-261. http://arxiv.org/pdf/1506.04976v2.pdf
Connie Stewart (2016). An approach to measure distance between compositional diet estimates containing essential zeros. Journal of Applied Statistics 44.7 (2017): 1137-1152.
# NOT RUN {
x <- as.matrix(iris[, 1:4])
x <- x/ rowSums(x)
ina <- iris[, 5]
mod1 <- compknn.tune(x, ina, a = seq(1, 1, by = 0.1) )
mod2 <- alfaknn.tune(x, ina, a = seq(-1, 1, by = 0.1) )
# }
Run the code above in your browser using DataLab